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ABSTRACT 

A novel iterative algorithm to solve linear programming (LP) problems based 
upon a newly identified set of four (and/or possibly six) distinct types of simplex pivoting 
steps defined over a symmetric primal-dual pair of LP, is presented. The two (or possibly 
four) types of classical (standard) simplex pivots are the Primal Standard Pivot with 
positive (and/or zero) indicator, and the Dual Standard Pivot with negative (and/or zero) 
indicator. The newly identified pivot types are: the Primal Tricky Pivot with positive 
indicator and the Dual Tricky Pivot with negative indicator. 



The Symmetric Primal-Dual Simplex Algorithm is an iterative solution strategy, 
wherein each iteration consists of the selection and application of exactly one pivoting 
step, chosen in a well defined systematic preference order (for our convenience, at least), 
from among the possibly four (or even six) distinct types of pivots, that may be valid 
depending on the Tableaux data entries. 

For expressional convenience, this algorithm is discussed using the Tucker's 
Compact Symmetric Tableaux (CST) for Linear Programming problems expressed in the 
standard (canonical) form representing the symmetric Primal-Dual Pair. An analysis of 
the evolution of the Tableaux data entries pattern observed as iterations proceed, is also 
presented. A classification of the LP problem into one of the six types is identified based 
on the data entries pattern observed in the final Tableaux. 

1. INTRODUCTION: 

Linear Programming (LP) problem represents one of the most widely used class 
of numerical/quantitative computational models, for which any possible improved 
solution technique would certainly be highly desirable. Of course, there has been several 
alternative solution strategies suggested including the classical simplex method of 
Dantzig [1] and several variations thereof, followed by recent polynomial time 
algorithms, namely the Ellipsoid Method of Khachiyan [2, 3] and the Karmarkar 
Algorithm [4] both classified now as belonging to Interior Point Algorithms. 
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In this paper, a novel generalization of the classical Simplex Method of Dantzig is 
presented. The fundamental concept in Dantzig's Simplex Method consists of moving 
from one basis (Tableaux) to a neighbouring basis (Tableaux), by a single exchange 
between a non-basic (entering) variable and a basic (leaving) variable, appropriately 
selected. We associate the term "Simplest Algorithm" for our method because this 
fundamental feature is being preserved. The proposed algorithm is an enhancement over 
the Dantzig's Simplex Method, in terms of providing a wider scope for the selection of 
the pivots, as can be seen in the ensuing discussions. The development of the algorithm 
is mainly supported by the identification of a set of possibly four (or even six) distinct 
types of simplex pivot selections, maintaining a sense of symmetry between the primal 
and the dual problems. Also, for expressional efficiency or at least convenience, the 
solution strategy and the analysis thereof are all based on the Tucker's Compact Simplex 
Tableaux for LP expressed in the standard (canonical) form representing the symmetric 
primal-dual pair. Hence, we justify the chosen name for the present algorithm: 
"Symmetric Primal-Dual Simplex Algorithm for Linear Programming". 

2. PRELIMINARIES: 

We will go through some well known preliminaries for the sake of establishing 
the notational conventions used in this paper. The Symmetric Primal-Dual Pair of LP in 
the Standard Canonical Form is as follows. 

Primal Problem: 

Maximize c.x = f 

s.t. A.x < b (1) 

x > 0 



Dual Problem: 

Minimize v.b = g 

s.t. v.A > c (2) 
v > 0 



The matrix-dimensional descriptions 
(1) and (2) above are as follows: 

x Primal decision Variables 

c Primal objective function coeffs 

f Primal objective function value 

A Primal constraint coeffs matrix 

b Primal constraint upper bound 

v Dual decision variables 

g Dual objective function value 



for each of the problem parameters/data in 

nxl vector 
lxn vector 
lxl scalar 
mxn matrix 
mxl vector 
lxm vector 
lxl scalar 
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We introduce the mxl vector y of slack variable to (1) and the lxn vector u of 
surplus variables to (2) to rewrite this Symmetric Primal-Dual pair in an equivalent form 
as follows : 



Primal Problem: 

Maximize 
s.t. 



Dual Problem: 

Minimize 
s.t. 



c.x + O.y = f 
A.x + I m .y = b 
x, y > 0 



v.b + u.O = g 
v.A - u.I n = c 
v, u > 0 



(3) 



(4) 



This Symmetric Primal-Dual pair is represented in the Compact Symmetric 
Tableaux (CST) as: 



(5) 



Vi 



X J 


-1 




a ij 


bi 


= -y; 


Cj 


0 


= f 


II 

Uj 


ll 

g 





For the LP problem pair (1) & 

(2) or equivalently (3) & (4) the Tableaux (5) represents the initial Tableaux indicating 
the initial basic solution (IBS) wherein y; are the primal basic variables in the initial basis 
associated (one to one permanent association) with v; the dual non-basic variables, and xj 
are the primal non-basic variables associated (one to one permanent association) with Uj 
the dual basic variables, in the initial basis. Note that xj (and a -1) are column-labels and 
Vi (and a -1) are row labels in the Tableaux (5), and the way to interpret (read) the 
Tableaux is as follows: 



Primal Problem: 

I 



je C 



ay . Xj - bi = -yi , i e R (row index) 



(6) 



2 Cj . Xj - 0 = f (function to be maximized) 

je C 
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X V; . ay - Cj = Uj , j e C (Column index) (7) 

ie R 

X V; . b; - 0 = g (function to be minimized) 

ie R 

wherein the variables xj, yi, v;, Uj are all considered to be non-negative. 

3. ALGEBRA (AIRTHMETIC) OF THE PIVOTING PROCESS: 

It is an interesting but simple enough exercise to observe that once a pivot 
element is selected, the actual pivoting process (the algebra and hence the arithmetic 
operations) is the same irrespective of the pivot selection; for example whether it is a 
primal pivot or a dual pivot. Hence it suffices to present here a single (common) set of 
operations representing that pivoting process. 

For the sake of generality, let us imagine that we are somewhere in the middle of 
solving a LP problem, and have the system model represented by a Tableaux as follows: 





Z N 


-1 




W, N 


tty 


ft 


= -z* (8) 


-1 




5 


= f 




II 


II 

g 





By the nature of the sequence of elementary row (column) operation being 
performed during any pivoting process, the system model represented by (8) is equivalent 
to that represented by the initial Tableaux (5) which corresponds to the primal-dual pair 
(6) & (7). The transformed version of the primal-dual pair directly expressed by (8) is as 
follows. 



Primal: 



(9) 
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Pi - X <Xij . zj N , i e R (row index) 

j e C 

-8 + X Yj . zj N , (function to be maximized) 

j e C 



f = 



Dual: 



W; = 



g 



■ Yj + ^- w; N . ay , j £ C (column index) 

i£R 

5 + X w; N . Pi (function to be minimized) 



(10) 



i e R 



The effect of a pivoting operation on (9) & (10) performed with a chosen pivot 
element a D is exactly to affect an exchange between the variables indicated by I and J 
in (9) and (10). That is, z : N is entered into primal basis in exchange for z^ in (9), and 
Wj N is entered into dual basis in exchange for Wj B in (10). Suppose we have chosen the 
pivot element a u using some appropriate pivot selection scheme, and we would like to 
derive the resulting Tableaux. Let the resulting Tableaux be indicated as: 





(Zi N )' 


-1 




(w, N )' 


( a u)' 


(pi)' 


= -(z*)' (") 


-1 


(Yj)' 


(5)' 


= (ff 




II 

W 


ii 

(g)' 





Then the process of deriving (11) from (8) constitute the algebra (arithmetic) of 
the pivoting process and is detailed below (without any derivational justifications): 



(au)' <- (1/au) ; (o^)' 

(aij)' <- - (aij/au) ; 

(aij)' <- ay - (aij/au)aij ; 

(Yj)' ^ Yj - (aij/au)yj ; 



(aij)/a D ; (Pi)' <- (fc/a u ) ; 

(yj)' ^ - (yj/au) ; 

(PO' ^ Pi - (Pi/an)aij ; 
(5)' «- 5 - (Pj/a^yj ; 



followed by an exchange of the labels - associated with the row I and the column J; that 
is effectively: 
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( Zj n )* <- Z B ; (Z, B )* <- Zj n ; 

^ N )' - & 



( Zj N )' <- Zj N ; ( Z , B )' <- Zi B ; 



and 

(Wj B )* <- w, N ; (w, N )* <- W; B 
( Wj B )* <- Wj B ; (w, N )' <- w, N ; 

for ie R\ {1} and j e C\ {J}. 

This completes the pivoting process. 



4. SIMPLEX PIVOT SELECTION SCHEMES: 

There are four (two pairs) fundamental types of pivot selection schemes namely 
Primal Standard Pivot (PSP), Dual Standard Pivot (DSP), Primal Tricky Pivot (PTP) and 
Dual Tricky Pivot (DTP). Further a primal/dual standard pivot can again be classified 
into one with positive/negative indicator (that is PSPPI and DSPNI) and one with zero 
indicator (that is PSPZI and DSPZI), thus resulting in a set of possible six distinct types 
of pivot selection schemes, that are available for simplex pivoting process in solving 
linear programming problems. The algebra of the pivot selection schemes are given 
below in Figure- 1, along with a schematic representation of the Tableaux data entries 
pattern that leads to such pivot selection. 

It can be easily observed that a primal (dual) tricky pivot with zero indicator is 
essentially the same as dual (primal) standard pivot with negative (positive) indicator, 
wherein the resultant minimum-ratio comes out to be zero. 



5. EFFECT OF PIVOTING OPERATION: 

It is useful at this point to make a few observations regarding the effect of 
pivoting operation, in each of the above pivot selection schemes. 

DSPNI brings about an immediate improvement in the primal feasibility w.r.t. the 
pivot row, without deterioration of dual feasibility. The extent of this improvement in 
primal feasibility can be measured by the corresponding improvement (decrease) 
observed in the value of the dual objective function, given by | Pf/j/ an | . 

PSPPI brings about an immediate improvement in the dual feasibility w.r.t. the 
pivot column, without deterioration of primal feasibility. The extent of this improvement 
in dual feasibility can be measured by the corresponding improvement (increase) 
observed in the value of the primal objective function, given by | Pf/j/ an | . 
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4. 1 Dual Standard Pivot with Negative Indicator, DSPNI: 



• 






• 


• 


e 


+ 


e 


• 



I e { i e R I ft <0}; 

J <- arg min {(y/aij) | pi < 0; y < 0; < 0} ; 

j e C 



4.2 Primal Standard Pivot with Positive Indicator, PSPPI: 



• 


• 




+ 


• 


e 


+ 


e 


• 



J e {j e C | Yj >0}; 

I <- arg min {( ft/cm) | p, > 0; ^ > 0; a u > 0}; 



i g R 



4.3 Primal Tricky Pivot (with Positive Indicator), PTPPI: 





• 




• 


• 


e 


+ 


e 


• 



J g {j e C | yj >0}; 

I <- arg max {(fr/ay) | p, < 0; y : > 0; aij<0} ; 
i g R 



4.4 Dual Tricky Pivot (with Negative Indicator), DTPNI: 



+ 


• 




• 


• 


e 


+ 


e 


• 



I g { i e R | Pi < 0}; 

J <- arg max {(y / aij) | Pi < 0; y > 0; ay > 0} ; 

jGC 



4.5 Dual Standard Pivot with Zero Indicator, DSPZI: 

I e { i e R | Pi = 0}; 



• 


• 




• 




0 


• 


• 


+ 


+ 


e 


• 



J <- arg min {(y / aij) | Pi = 0; y < 0; aij < 0} ; 

j e C 



4.6 Primal Standard Pivot with Zero Indicator, PSPZI: 

J g {j eC | y =0}; 



• 


• 


• 




• 


+ 


• 


e 


+ 


0 




• 



T 



I <- arg min {( ft /ay) | p, > 0; yj =0; a iT >0}; 

i G R 



Figure- 1. Six types of Simplex Pivot Selection Schemes 

negative; 0 zero; + positive; 0 non-positive; * any value; © non-negative; • un-analyzed 
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PTPPI brings about an immediate improvement in the primal feasibility w.r.t. the 
pivot row, without any concern to the dual feasibility. The extent of this improvement in 
primal feasibility can be measured by the corresponding improvement (increase) in the 
value of the primal objective function, given by | fiffj/ an | . 

DTPNI brings about an immediate improvement in the dual feasibility (w.r.t. the 
pivot column, at least) without any concern to the primal feasibility. The extent of this 
improvement in dual feasibility can be measured by the corresponding improvement 
(decrease) in the value of the dual objective function, given by | fryj/ au | . 

The other two types of pivot selections namely PSPZI and DSPZI are utilized to 
affect a change in the basis, in situations with multiple-solutions and/or degeneracy, and 
do not in any way affect the primal or dual feasibilities. However, they certainly play an 
important role in the overall solution strategy. 

From the above, one can observe that as a general, uniform and common basis for 
a local effectiveness measure ( lem ) of a particular pivoting operation (applicable for any 
and every iteration, for both primal and dual) we can use the absolute value of the change 
in the value of the objective function, given by l_em(l, J) = abs(Piyj/au). Although it is 
not specifically suggested here, one can opt to choose a pivot possibly to maximize this 
local effectiveness measure ( lem ) in every iteration among the possible pivots of a 
particular type or even among of all the possible pivots of all the possible types. Even, if 
done so, it cannot be guaranteed (as per worst case analysis) to minimize the overall 
number of iterations required for reaching an optimum solution. It requires further 
research work to thoroughly understand, analyze and incorporate the concept of a 
possible '' local effectiveness measure ''' ( lem ) for a single simplex pivoting operation to the 
fullest extent, that would be equivalent to a guaranteed improvement in some 
corresponding global effectiveness measure ( gem ) defined appropriately for the given LP 
problem; in developing an efficient solution strategy. For now, let us come to the main 
algorithm itself. 



6. SYMMETRIC PRIMAL-DUAL SIMPLEX ALGORITHM: 

The six distinct types of pivot selection schemes are considered in the following 
order of preference: 

{{ DSPNI, PSPPI}, {PTPPI, DTPNI}, {DSPZI, PSPZI}} 

At every iteration, an attempt is made to select a pivot element, by checking the 
possible pivot selections belonging to one of the above six types of pivot selection 
schemes in the preference order pre-specified. 
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That is, a pivoting operation is executed with a pivot element of the type - 

i. DSPNI if possible, 

ii. PSPPI only if none of DSPNI is possible, 

iii. PTPPI only if none of DSPNI nor PSPPI is possible, 

iv. DTPNI only if none of DSPNI, PSPPI, PTPPI is possible, 
and when none of the above four is possible, go for 

v. DSPZI and/or 

vi. PSPZI in order to explore the possible alternative basic solutions. 

It is to be noted that depending upon the actual data entries in the Tableaux, a 
pivot selection of specific type which was not possible in an earlier iteration, can become 
possible in a later iteration, sometimes even in the very next following iteration. That is 
why it is a crucial part of the algorithm to check in each and every iteration, for each of 
the six types of possible pivot selection schemes in the pre-specified order. 

7. EVOLUTION OF TABLEAUX DATA ENTRIES PATTERN: 

As a means to show the convergence of the algorithm to one of the possible six 
termination patterns (discussed later), an analysis of the evolution of the Tableaux data 
entries pattern is given here. Figure-2 gives the six different patterns applicable when 
each of the six different pivot selection schemes may be chosen as a possibility in some 
iteration during the process of solving a LP problem. 

Figure-2 needs to be read keeping in mind the algebra of the pivoting process and 
the details regarding the nature of the pivot selection itself. To facilitate the analysis of 
the possible termination patterns, it is useful to look at a systematic classification of all 
the 27 possible combinations of Tableaux data entries pattern as shown in Figure-3. 
Here, the possible situations that would lead to a successful pivoting are indicated- they 
add up to ten, including the four situation corresponding to multiplicity/degeneracy. 
Others wherefor no pivot selection is possible, are marked according to the nature of the 
termination, by indicating F for basic-feasible-finite, O for infeasible and co for non- 
basic-feasible-infinite, corresponding to both primal and dual variables. Note that this 
classification is as per the quite well established approach, although a refinement is 
indicated to distinguish the case wherein primal (dual) has an infinite non-basic optimum 
with finite value for the objective function while the dual (primal) has a feasible-finite 
optimum. This distinction from the classical approach arises because we give primary 
emphasis on the classification based on the nature of the decision variables at 
termination, and give secondary emphasis on the finiteness (or otherwise) of the objective 
function value. 
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(a) DSPNI 











* 


e 


+ 


e 


* 



(b) PSPPI 





e 




+ 




e 


+ 


e 


* 



T 



(c) PTPPI 





e 




e 




e 


+ 


e 


* 



T 



(d) DTPNI 



+ 


e 




e 




e 


+ 


e 


* 



(e) DSPZI 



0 


e 


e 




e 






0 


e 




* 


+ 


+ 


0 




* 



(f) PSPZI 



0 




© 




e 


+ 




0 


e 


+ 




+ 


+ 


0 




* 



T 



Figur-2. Evolution of Tableaux data entries pattern 

— negative; 0 zero; + positive; 

0 non-positive; * any value; © non-negative 
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+ 
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+ 
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Figure-3. Twenty seven distinct combinations of Tableaux data entries pattern. 

— negative; 0 Zero; + positive; * any value 



Thus the seventeen (out of the total of twenty seven) situations that lead to non 
pivoting termination can be classified into six distinct classes as follows 



i) Six situations with 


P = 


= F, 


D = 


= F 


ii) One situation with 


P = 


= F, 


D = 


= oo 


iii) One situation with 


P = 


= 00, 


D = 


= F 


iv) Four situations with 


P = 


= 00, 


D = 


= 0 


v) Four situations with 


P = 


= o, 


D = 


= oo 


vi) One situation with 


P = 


= o, 


D = 


= 0 



SPDSA4LP 



Page 11 of 13 



KpH 



KREC Research Bulletin (ISSN-0971-3603) : 9 ( 1 ) June-20 00 , ppl 6-2 6 



Four among the remaining ten (out of the total of twenty seven) situations that 
indicate pivoting possibilities can be included in case (i) above and treated as possible 
termination situations because further pivoting would be useful only to the extent of 
discovering multiple optima for the primal/dual. The other six correspond to the six 
types of pivot selection schemes indicated. Figure-4 summarises these observations. 

From the above discussion and the observations presented in Figures 1, 2, 3 and 4, 
it is clear that the algorithm converges to one of the six distinct classes of termination 
situations and the given LP-Problem can be classified accordingly. 

8. SOME GENERAL COMMENTS: 

It is worth noting here that using the above proposed algorithm one can solve any 
LP problem, by first converting it into the standard/canonical form and then applying the 
proposed algorithm. In performing such transformation, it is possible to enhance the 
overall efficiency by the following approach: 

i) Free variables can be replaced by non-negative variables not double in 
number, but only just one extra in number. 

ii) Equations can be replaced by inequalities not double in number, but only 
just one extra in number 

iii) No need for use of artificial variables. 

iv) The initial basic solution need not necessarily be feasible. 

Degeneracy and possible cycling can be handled in the usual method, by 
lexicographic ordering of the variables (equivalent and in fact supported by the concept 
of polynomial perturbations technique). 

Also it is possible to have alternative ordering of the pivot selection schemes 
incorporated in the algorithm within each of the three subsets indicated in section 6 
above, although the relative ordering of these three subsets themselves is not to be 
altered. 

Although rigorous mathematical analysis of the computational complexity of this 
algorithm is yet to be studied in detail, it seems very likely to perform at least as good as 
(if not better than) the existing solution techniques for linear programming. 
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Figure-4. Six categories for Tableaux data entries pattern at termination. 

- negative; 0 zero; + positive; 

0 non-positive; * any value; © non-negative; • un-analyzed 
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